

SPECIFICATION 



PROJECTION DISPLAY APPARATUS, DISPLAY METHOD FOR 



SAME AND IMAGE DISPLAY APPARATUS 



Technical Field 

The present invention relates to an image display apparatus, and more 
particularly to a projection display apparatus technology. 



The ability of a projection display apparatus to take input images and 
display them enlarged on a screen has led to the extensive use for presentations. 
In a presentation a commentary accompanies the images projected onto the 
screen. Generally, multiple pages of presentation images are used. While each 
page of presentation images is different, usually a number of the images are 
interrelated, so it is necessary to cut back and forth between related presentation 
pages. Therefore, users want to be able to simultaneously display at least some 
of multiple pages of interrelated presentation images. 

Also, during question and answer sessions or when a short time is needed 
before a new set of images can be displayed, companies like to display corporate 
logos, products and other such images (which will also be referred to as specific 
images) instead of presentation images. In the prior art, specific images were 
supplied to the projection display apparatus via an image source apparatus such 
as a computer, video player, TV receiver or the like. Thus, the problem has been 
that the specific image data has had to be stored beforehand in the image source 
apparatus connected to the projection display apparatus. 



Background Art 
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When no images are being input to the projection display apparatus the 
screen remains blank. In such situations, in the prior art the projection display- 
apparatus displays a one-color screen image called a blank image. In this 
situation too, users have expressed a desire to display specific images. However, 
5 this has not been possible because normal images are not being input from the 
image source apparatus. This problem is not limited to the projection display 
apparatus, but is also shared by image display apparatus that display images 
supplied externally. 

1 0 Disclosure of the Invention 

This invention was accomplished to overcome the foregoing problems of the 
prior art. A first object of the invention is to provide a technology that enables 
related portions of multiple pages of images to be displayed simultaneously. A 
second object is to provide a technology that enables specific images to be 

15 displayed even when the specific images are not supplied externally. 

In accordance with a first aspect of this invention, the above object is 
attained by a projection display apparatus that comprises: an image extraction 
section that extracts at least a portion of given first image data as an extraction 
image; an extraction image memory for storing extraction image data 

20 representing the extraction image; an image overlay section that generates 
overlaid image data by superimposing the extraction image on original image 
represented by given second image data; a light modulation unit that is driven 
responsive to the overlaid image data pixel by pixel; and an optical system for 
projecting onto the screen the overlaid image obtained by the light modulation 

2 5 unit. 



2 

3 



# • 



Since this projection display apparatus contains a section for extracting at 
least a portion of a given image, and an image overlay section for superimposing 
the extracted image on the original image, it is possible to simultaneously display 
multiple pages of interrelated image portions. 
5 It is preferable that the image extraction section can arbitrarily set the 

portion to be extracted from the first image data, since this makes it easier to 
produce extraction image data for a particular purpose. 

It should also be possible for the image overlay section to superimpose the 
extraction image at a desired position on the original image, since that provides 

10 more freedom with respect to overlaying extraction images. 

It is also preferable that the extraction image memory stores a plurality of 
extraction image data representing a plurality of extraction images, and the 
image overlay section superimposes at least one selected extraction image at each 
specified position on the original image. 

15 Doing this makes it possible to select an arbitrary extraction image from 

among a plurality of extraction images, enabling a desired extraction image to be 
overlaid on an original image. 

It is preferable for the image overlay section used in the projection display 
apparatus to be equipped with a synthesizer section that generates the overlaid 

2 0 image data by synthesizing the given second image data and the extraction image 
data read out from the extraction image memory; and a frame memory for storing 
the overlaid image data, the frame memory having at least a memory area 
corresponding to all the pixels of the light modulation unit. In this case, the 
overlaid image data read out of the frame memory is supplied to the light 

2 5 modulation unit. 



4 



With this configuration, since image data consisting of the extraction 
images superimposed on the original image is written to a frame memory, the 
overlaid image can be obtained by reading the overlaid image data from the frame 
memory. 

5 Alternatively, It is preferable for the image overlay section used in the 

projection display apparatus to be equipped with a frame memory for storing the 
given second image data, the frame memory having at least a memory area 
corresponding to all the pixels of the light modulation unit; and a synthesizer 
section that generates the overlaid image data by synthesizing the second image 

10 data read out from the frame memory and the extraction image data read out 
from the extraction image memory, with the overlaid image data synthesized by 
the synthesizer section being supplied to the light modulation unit. 

This configuration allows the overlaid image data to be obtained in the 
projection display apparatus. Thus, this projection display apparatus has the 

15 same function and advantage as the preceding apparatus. Compared to the 
preceding configuration in which the overlaid image data is read out of the frame 
memory and displayed, in this configuration the extraction image is superimposed 
as the image data is being read out of the frame memory. Therefore, the time 
taken from the initial overlay command to the display of the overlaid image is 

2 0 shorter. 

In another preferred arrangement, the synthesizer section comprises a 
data selector that selects either one of the second image data and the extraction 
image data, pixel by pixel, to produce the overlaid image data. 

With this configuration, since the data selector selects either one of the 
2 5 second image data and the extraction image data, an extraction image can be 
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superimposed on the original image by substituting extraction image data for part 
of the original image data. 

It is preferable for the synthesizer section to be equipped with a multiplier 
section that multiplies the second image data and the extraction image data by 
5 respective coefficients on a pixel by pixel basis; and an adder section that adds the 
multiplied second image data and the extraction image data on a pixel by pixel 
basis. 

With this configuration, the coefficients can be used to adjust the density 
ratio between the embellishment image and the original image. 

10 In another preferred configuration, the synthesizer section comprises a 

coefficient setting section that controls the coefficients in the multiplier section 
to change a synthesis ratio between the second image data and the extraction 
image data, thereby adjusting a degree of transparency of the extraction image 
superimposed on the original image. 

15 Doing this enables the synthesis ratio between the image data and the 

extraction image data to be altered by controlling the coefficients of the multiplier 
section, making it possible an overlay image in which the portion overlaid by an 
extraction image is transmitted. 



2 0 coefficient setting section changes the coefficients in the multiplier section with 
time to change the synthesis ratio between the second image data and the 
extraction image data, thereby changing the degree of transparency of the 
extraction image superimposed on the original image with time. 



2 5 transparency of the portion on which an extraction image is overlaid by changing 



In the above projection display apparatus, also, it is preferable that the 



Doing this makes it possible to change with time the degree of 
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the coefficients of the multiplier section with time. 

A projection display apparatus according to a second aspect of the 
invention comprises: a frame memory for storing image data representing an 
image to be displayed; a image display signal generator for generating image 
5 display signals based on the image data stored in the frame memory; a electro- 
optical device for emitting light to form images responsive to the image display 
signals; a projection optical system for projecting light emitted by the electro- 
optical device; an image extraction section that extracts at least a portion of an 
extraction target image selected arbitrarily from among images given externally 
=J] 10 as an extraction image; an extraction image memory for storing extraction image 
UJ data representing the extraction image; and a specific image display control 

HJ section that in a specific display condition displays a specific image represented 

by specific image data including the extraction image data stored in the 
bi extraction image memory. 

H 15 With this configuration, at least a part of a selected target image can be 

~ acquired as the extraction image. In a specific display condition, this makes it 

possible to display specific image that include arbitrarily extracted image, in 
place of image given to the projection display apparatus. Thus, desired specific 
image can be displayed even when specific images are not being supplied from an 
2 0 external source. 

In another preferred configuration, the image extraction section 
implements the steps of: displaying an extraction image setting screen for setting 
image extraction conditions comprising at least an extraction area and an 
extraction magnification factor; displaying an extraction area specifying image 
25 used in setting the extraction area on the extraction target image; when the 
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extraction area is set with the extraction area specifying image, writing into the 
frame memory selected extraction image data representing a selected extraction 
image corresponding to the set extraction area; when a display magnification 
factor is set, enlarging or reducing the selected extraction image data based on 
5 the magnification factor and writing the enlarged or reduced selected extraction 
image data into the frame memory; and when a desired display magnification 
factor is determined, storing the selected extraction image data enlarged or 
reduced based on the desired display magnification factor in the extraction image 
memory. 

10 The extraction image setting screen makes it easier to set the target 

extraction image area. Also, before a magnification factor is determined, it can 
be checked by displaying the selected extraction image corresponding to the set 
extraction area at the selected magnification factor concerned. 

In another preferred arrangement, the image extraction section displays 

15 a predetermined extraction frame as the extraction area specifying image, the 
predetermined extraction frame having a first black outline, a second black 
outline inside the first black outline and a white area between the first and 
second black outlines. 

This facilitates setting the extraction area by making it easy to distinguish 

2 0 the extraction area on the extraction target image. Whatever the color of the 
extraction target image is, black outlines or white image frame can be displayed 
clearly. 

In another preferred arrangement, the extraction image memory stores a 
plurality of extraction image data representing a plurality of extraction images; 
2 5 and the specific image display control section displays a specific image that 



7 

r 



# • 



include at least one extraction image selected from among the plurality of 
extraction images in the specific display condition. 

A specific image display control section can be used that selects at least 
two of the extraction images from among the plurality of extraction images and 
5 displays the selected images in order. 

The ability to choose from among a plurality of extraction images means 
that more effective specific image can be used. 

In another preferred configuration, the projection display apparatus 
includes an operating condition judging section that judges if the projection 
10 display apparatus is in a specific operating condition, wherein the specific image 
display control section displays the specific image when the specific operating 
condition is detected by the operating condition judging section. 

This configuration can automatically determine when the projection 
display apparatus is in a specific operating condition, and display specific image 
15 that includes extraction image extracted by the image extraction section. 

Specifically, the operating condition judging section is configured to detect 
as the specific operating condition at least one state selected from a state in which 
no image signal is being given to the projection display apparatus, and another 
state in which the projection display apparatus is within a prescribed period after 
2 0 startup. 

In each of these states, in which the projection display apparatus cannot 
perform its normal display function, specific image that include extraction image 
extracted by the image extraction section can be automatically displayed. 

A projection display apparatus according to a third aspect of the invention 
2 5 comprises: a frame memory for storing image data representing an image to be 
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displayed; a image display signal generator for generating image display signals 
based on the image data stored in the frame memory; a electro-optical device for 
emitting light to form images responsive to the image display signals; a projection 
optical system for projecting light emitted by the electro-optical device; an 
5 operating condition judging section that judges if the projection display apparatus 
is in a specific operating condition; and a specific image display control section 
that displays the specific image represented by the specific image data when the 
operating condition judging section detects the specific display condition. 

This configuration can automatically determine when the projection 
10 display apparatus is in a specific operating condition, and display specific images 
at such times. 

For this, preferably the operating condition judging section detects as the 
specific operating condition at least one state selected from a state in which no 
image signal is being given, and a state in which the projection display apparatus 

15 is within a prescribed period after startup. 

As described above, in each of these states in which the projection display 
apparatus cannot perform its normal display functions, specific image that 
include extraction image extracted by the image extraction section can be 
automatically displayed. 

2 0 An image display apparatus according to a fourth aspect of the invention 

comprises: a frame memory for storing image data representing an image to be 
displayed; a image display signal generator for generating image display signals 
based on the image data stored in the frame memory; a electro-optical device for 
emitting light to form images responsive to the image display signals; an image 

2 5 extraction section that extracts at least a portion of an extraction target image 
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selected arbitrarily from among images given externally as an extraction image; 



extraction image; and a specific image display control section that in a specific 
display condition displays the specific images represented by a specific image data 
5 including the extraction image data stored in the extraction image memory. 

This image display apparatus has the same function and advantage as the 
projection display apparatus according to the fourth aspect. In a specific display 
condition selected by a user, the image display apparatus can display specific 
image that include arbitrarily extracted image in place of image given to the 

10 image display apparatus. 

An image display apparatus according to a fifth aspect of the invention 
comprises: a frame memory for storing image data representing an image to be 
displayed; a image display signal generator for generating image display signals 
based on the image data stored in the frame memory; a electro-optical device for 

15 emitting light to form images responsive to the image display signals; an 

operating condition judging section that judges if the projection display apparatus 
is in a specific operating condition; and a specific image display control section 
that displays the specific image represented by the specific image data when the 
operating condition judging section detects the specific display condition. 

2 0 This image display apparatus has the same function and advantage as the 

projection display apparatus according to the third aspect. It can automatically 
detect when the image display apparatus is in a specific display condition, and 
display specific images. 



2 5 images using a projection display apparatus having a light modulation unit to 



an extraction image memory for storing extraction image data representing the 



In accordance with a sixth aspect of the invention, a method of displaying 




display an image based on image data given to the projection display apparatus 
by projecting the image on a screen, which comprises the steps of: extracting at 
least a portion of given first image data as an extraction image; preparing 
extraction image data representing the extraction image; generating overlaid 
5 image data by superimposing the extraction image on an original image 
represented by given second image data; driving light modulation unit responsive 
to the overlaid image data pixel by pixel basis; and projecting onto a screen 
overlaid images obtained by the light modulation unit. 

This display method has the same function and advantage as the 
10 projection display apparatus according to the first aspect, enabling simultaneous 
display of related portions of multiple pages of images. 

A display method according to a seventh aspect of the invention comprises 
the steps of: extracting at least a portion of a given extraction target image as an 
extraction image; preparing extraction image data representing the extraction 
15 image; and in a specific display condition, displaying a specific image represented 
by specific image data including the extraction image data. 

This display method has the same function and advantage as the 
projection display apparatus according to the second aspect, enabling a specific 
image to be displayed even when the specific image is not being supplied from an 
2 0 external source. 

A display method according to an eighth aspect of the invention comprises 
the steps of: judging if the projection display apparatus is in a specific operating 
condition; when it is judged that there is a specific operating condition, storing 
specific image data to a frame memory to display a specific image represented by 
2 5 specific image data. 
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This display method provides the same function and advantage as the 
projection display apparatus according to the third aspect, and is able to 
automatically determine when the projection display apparatus is in a specific 
operating condition, and display specific images at such times. 
5 At least part of the functions of the above-described method steps and 

components of the invention can be implemented by a computer program recorded 
on computer-readable recording media such as floppy disks, CD-ROMs, opto- 
magnetic disks, punched cards, bar codes and other such printed symbols, 
internal storage device (including RAM and ROM) and external storage device. 

10 

Brief Description of the Drawings 
Fig. 1 is a block diagram for schematically illustrating a first embodiment 
of the general configuration of a projection display apparatus according to a first 
aspect of the invention. 
1 5 Fig. 2 is a block diagram for schematically illustrating the configuration 

of a video signal conversion circuit 10. 

Fig. 3 is a block diagram showing the configuration of the video processor 

34. 

Figs. 4(a)-(d) are diagrams for explaining the frame memory 22, extraction 
2 0 image memory 24 and extraction image bitmap memory 26 used in this 
embodiment. 

Fig. 5 is a block diagram for schematically illustrating the configuration 
of the extraction image overlay circuit 12. 

Figs. 6(a)-(c) are diagrams for explaining the overlay operation with 
2 5 respect to image data stored in the frame memory 22 and extraction image 
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bitmap data BMD1 stored in the extraction image bitmap memory 26. 

Fig. 7 is a diagram for explaining the extraction image bitmap data BMD1 
expanded in the extraction image bitmap memory 26. 

Figs. 8(a)-(c) are diagrams for explaining examples of displays on a 
5 projection screen 104 of images input from a personal computer on which 
extraction images have been superimposed. 

Fig. 9 is another diagram for explaining the display on a projection screen 
104 of an image input from a personal computer on which an extraction image 
has been superimposed. 
1 0 Fig. 10 is a diagram for explaining the extraction image bitmap memory 

26 when the extraction image of Fig. 9 is expanded. 

Figs. 11(a) and 11(b) are diagrams for explaining projected images overlaid 
with transparent extraction images. 

Fig. 12 is a block diagram for schematically illustrating the general 
15 configuration of a second embodiment of the projection display apparatus 
according to a first aspect of the invention. 

Fig. 13 is a block diagram for schematically illustrating the configuration 
of a video signal conversion circuit 60. 

Fig. 14 is a block diagram showing a configuration of the video processor 



Fig. 15 is a block diagram for schematically illustrating the general 
configuration of an embodiment of the projection display apparatus according to 
a second aspect of the invention. 

Fig. 16 is a block diagram for schematically illustrating the configuration 
2 5 of the video signal processing circuit 210. 
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Fig. 17 is a block diagram showing a configuration of the video processor 

234. 

Fig. 18 is a diagram illustrating the extraction image memory 224. 
Fig. 19 is a diagram for explaining externally input images displayed on 
5 a projection screen 104. 

Fig. 20 is a diagram for explaining the projection screen display of a 
specific image represented by the specific image data SPD1 that includes 
background image data BGD1 and extraction image data CPD1 stored in 
extraction image memory 224. 
10 Figs. 21(a)-(c) are diagrams for explaining the display on the projection 

screen 104 of sequentially selected extraction images represented by extraction 
image data CPD1 (A), CPD1 (B) and CPD1 (C). 

Fig. 22 is a diagram to illustrate the procedure for cutting away from an 
image being input to the projection display apparatus, to a user logo image. 
15 Fig. 23 is a diagram for explaining the procedure for cutting away from an 

image being input to the projection display apparatus, to a user logo image. 

Fig. 24 is a diagram for explaining the procedure for cutting away from an 
image being input to the projection display apparatus, to a user logo image. 

Fig. 25 is a diagram for explaining the procedure for cutting away from an 
2 0 image being input to the projection display apparatus, to a user logo image. 

Fig. 26 is a diagram for explaining the procedure for cutting away from an 
image being input to the projection display apparatus, to a user logo image. 

Fig. 27 is a diagram for explaining the procedure for cutting away from an 
image being input to the projection display apparatus, to a user logo image. 
2 5 Fig. 28 is a block diagram for schematically illustrating the general 
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configuration of an embodiment of the projection display apparatus according to 
second and third aspects of the invention. 

Fig. 29 is a block diagram showing the configuration of the operating 
condition judging section 226. 
5 Figs. 30(a)-(e) are time charts of the operation of the operating condition 

judging section 226. 

Best Modes of Carrying Out the Invention 

10 A. First Embodiment: 

Some modes for carrying out the present invention are described below as 
preferred embodiments. Fig. 1 is a block diagram for schematically illustrating 
a first embodiment of the general configuration of a projection display apparatus 
according to a first aspect of the invention. The projection display apparatus 

15 includes a video signal conversion circuit 10, an extraction image overlay circuit 
12, a liquid crystal display driver circuit 14, a liquid crystal display panel 16, a 
frame memory 22, an extraction image memory 24, an extraction image bitmap 
memory 26, a remote control section 28, a CPU 20, an illumination optical system 
100 and a projection optical system 102. The video signal conversion circuit 10, 

2 0 extraction image overlay circuit 12, extraction image memory 24, remote control 
section 28 and CPU 20 are connected to via a bus 1. The liquid crystal display 
driver circuit 14 is also connected to the bus 1, but thie is not shown in Fig. 1. 
The liquid crystal display panel 16 is uniformly illuminated by the illumination 
optical system 100, and images displayed on the liquid crystal display panel 16 

2 5 are projected onto the projection screen 104 by the projection optical system 102. 
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The optical systems 100 and 102 are shown in a simplified fashion. 

The video signal conversion circuit 10 is used to perform analog- digital 
conversion of analog video signals AVI, write the converted image data into the 
frame memory 22 and retrieve image data from the frame memory 22. The 
5 analog video signal AVI can be an RGB signal SI carrying a computer screen 
image, or a composite image signal S2 from a video recorder, TV or the like. 

Fig. 2 is a block diagram for schematically illustrating the configuration 
of the video signal conversion circuit 10. The video signal conversion circuit 10 
includes a sync separator 30, an A-D conversion section 32 and a video processor 



When the analog video signal AVI is a composite image signal S2, the sync 
separator 230 separates the signal S2 into a sync signal SYNC and a component 
image signal (analog image signals not including a sync signal) S3. The 
component image signal S3 is comprised of three color signals representing the 

15 red, green and blue images. If the analog video signal AVI that is received is an 
RGB signal SI, there is no need to use the sync separator 230 since there is a 
separate sync signal input. 

The A-D conversion section 232 contains multiple A-D converters for 
converting RGB signal SI or component image signal (RGB signal) S3 output by 

2 0 the sync separator 230 to image data DV1 for each color signal. The conversion 
timing of the A-D converters is controlled by a dot clock DCLK generated in the 
video processor 234, using the sync signal WSYNC. 

The video processor 34 is a microprocessor that performs various image 
processing functions such as controlling the input and output of image data to and 

2 5 from the frame memory 22. Image data DV1 from the A-D conversion section 32 
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34. 
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is stored in the frame memory 22 until required. 

Fig. 3 is a block diagram showing the configuration of the video processor 
34. The video processor 34 includes a write controller 70, a read controller 72 and 
an image extraction section 74. 



write controller 70 and read controller 72 generate addresses ADD1, ADD2 and 
control signals CTR1, CTR2 and supply them to the frame memory 22. Thus, the 
image data is written to the frame memory 22 in accordance with address ADD1 
and control signal CTR1 generated by the write controller 70, and read out of the 

10 frame memory 22 in accordance with address ADD2 and control signal CTR2 
generated by the read controller 72. These addresses and control signals are 
based on sync signals WSYNC and RSYNC. 

The writing of image data to the frame memory 22 is synchronized by the 
sync signal WSYNC. The retrieval of image data from the frame memory 22 and 

1 5 the downstream processing of the image data DV2 output by the video processor 
34 are synchronized by the sync signal RSYNC output by the liquid crystal 
display driver circuit 14 (Fig. 1) explained below. The first sync signal WSYNC 
and the second sync signal RSYNC are not mutually synchronized. However, 
sync signals WSYNC and RSYNC can be used synchronized. 

2 0 When image data that has been written into the frame memory 22 is read 

out, the image extraction section 74 (Fig. 3) extracts a specified portion of the 
image data. The image extraction section 74 compresses the extracted image data 
and writes it to the extraction image memory 24 via the bus 1. The extracted 
image data does not have to be compressed by the image extraction section 74. 

2 5 Also, the data can be reduced instead of compressed. The operation of specifying 
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When image data is written to, or read from, the frame memory 22, the 
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the portion of the image data to be extracted can be done using a remote 
controller 29. When the extraction portion has been specified by the remote 
controller 29, the CPU 20 outputs an extraction address SADD corresponding to 
the specified extraction portion. Based on the extraction address SADD and 
address ADD2 that is output from the read controller 72, the image extraction 
section 74 extracts the pixel data of the extraction portion. By doing this, only 
pixel data corresponding to specified portion can be extracted. 

The extraction image memory 24 shown in Fig. 1 is used to store the 
extraction image data extracted by the image extraction section 74 of the video 
processor 34 (Fig. 3). In this embodiment, the extraction image data is stored in 
compressed form in the extraction image memory 24 as compressed extraction 
image data CPD. The data CPD is expanded into extraction image bitmap data 
BMD1, which is stored in the extraction image bitmap memory 26. The extracted 
image data may also be stored in uncompressed form in the memory 26, in which 
case the extraction image memory 24 is unnecessary. 

Figs. 4(a)-(d) are diagrams for explaining the frame memory 22, extraction 
image memory 24 and extraction image bitmap memory 26 used in this 
embodiment. Figs. 4 (a) and (d) show the memory space in the frame memory 22, 
Fig. 4 (b) shows the memory space in the extraction image memory 24, and Fig. 
4 (c) shows the memory space in the extraction image bitmap memory 26. 

With reference to Fig. 4 (a), the frame memory 22 contains one frame of the 
input image data (a picture of a flower) in a bitmap format. The broken line 
shows the extraction portion, which is defined by the user, extracted and 
compressed by the image extraction section 74, and stored in the extraction image 
memory 24 as compressed extraction image data CPD. 
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As shown in Fig. 4 (b), the extraction image memory 24 contains multiple 
types of compressed extraction image data CPD and a program for expanding the 
compressed extraction image data CPD into a bitmap. The program is stored in 
the memory 24 starting at memory address 0000. Compressed data A, B and C 
5 are stored at starting addresses 0A00, 0B00 and 0C00, respectively. 

The extraction image bitmap memory 26 shown in Fig. 4 (c) is used to store 
extraction image bitmap data BMD1 expanded by the program in the extraction 
image memory 24, and coordinate data PD showing the overlay position and 
extent of the extracted image on the original image data. The extraction image 

10 bitmap data BMD1 (Fig. 4(c)) is expanded starting from address 0000 of the 
extraction image bitmap memory 26. The coordinate data PD is stored starting 
at address AAAA, and includes two point coordinates (xl, yl), (x2, y2). The first 
coordinate (xl, yl) denotes the overlay position of the extracted image within the 
image data, and the two coordinates (xl, yl), (x2, y2) denote the overlay extent 

15 (meaning the size) of the extraction image. 

The frame memory 22 shown in Fig. 4 (d) contains image data (a picture 
of a tree) in a bitmap format. The extraction image of Fig. 4 (c) is overlaid on 
above image. The coordinates (xl, yl), (x2, y2) shown in Fig. 4 (d) are based on 
the address 0000 of the frame memory 22 being for coordinates (0, 0). The 

2 0 coordinates (xl, yl), (x2, y2) correspond to the coordinate data PD of Fig. 4 (c), in 
which point a at the upper left of the extraction image bitmap data BMD1 
corresponds to the coordinates (xl, yl), and point b at the lower right corresponds 
to the coordinates (x2, y2). 

When a user selects one of the multiple extraction images prepared by 

2 5 extracting image data, it is expanded as extraction image bitmap data BMD1. A 
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user can obtain the coordinate data PD by specifying an overlay position within 
the image data, or the position and extent of the overlay. If just an overlay 
position is specified, coordinates (xl, yl) are determined, and the coordinate data 
(x2, y2) is set based upon predetermined sizes set according to the type of 
5 extraction image concerned. The size is determined when the extraction image 
is extracted. When both position and extent of the overlay are specified, 
coordinates (xl, yl) are set according to the overlay position specified, and in 
accordance with the overlay extent (size) specified, coordinates (x2 + Ax, y2 + Ay) 
are substituted for (x2, y2). This enables the extraction image to be enlarged or 
10 reduced to any desired size. Although in this embodiment the extraction image 
bitmap data BMD1 and coordinate data PD are stored in the extraction image 
bitmap memory 26, they can instead be stored in the extraction image memory 
24. 

The extraction image overlay circuit 12 (Fig. 1) overlays input images and 
15 extraction images. Specifically, the extraction image overlay circuit 12 overlays 
image data DV2 output by the video signal conversion circuit 10 and extraction 
image bitmap data BMD1 expanded in the extraction image bitmap memory 26 
(Fig. 4(c)). 

Fig. 5 is a block diagram for schematically illustrating the configuration 
2 0 of the extraction image overlay circuit 12. The extraction image overlay circuit 
12 includes two multipliers 40 and 42, an adder 44 and a coefficient setting 
section 46. The two multipliers 40 and 42 and the adder 44 constitute a 
configuration that is provided for each of the colors RGB. Image data DV2 output 
by the video processor 34 is input to the first multiplier 40, and the extraction 
2 5 image bitmap data BMD1 expanded in the extraction image bitmap memory 26 
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is input to the second multiplier 42. 

The coefficient setting section 46 is used to set the coefficients kl and k2 
of the multipliers 40 and 42. Coefficients kl and k2 can each be set to a value 
ranging from 0 to 1, and generally are set at a value that sums to 1. The 
5 coefficients kl and k2 are controlled by the coefficient setting section 46 based on 
the coordinate data PD (Fig. 4(c)). 

The multipliers 40 and 42 are used to multiply each pixel data of input 
image data by a constant factor. In the multiplier 40, the image data DV2 is 
converted to signals multiplied by kl. Similarly, extraction image bitmap data 
10 BMD1 is converted to signals multiplied by k2. The converted data output as 
image data DV3 and extraction image bitmap data BMD2 are input to the adder 



The function of the adder 44 is to add the pixel data of two input image 
signals. Thus, in the adder 44 the image data DV3 and the extraction image 
15 bitmap data BMD2 are added and output as overlay image data DDV1. The 
multipliers 40 and 42, adder 44 and coefficient setting section 46 correspond to 
the synthesizer section in the projection display apparatus according to the first 
aspect of this invention, 



2 0 circuit 12 is supplied to the liquid crystal display driver circuit 14 (Fig. 1). The 

liquid crystal display driver circuit 14 displays on the liquid crystal display panel 
16 the image with the extracted image overlay corresponding to the overlay image 
data DDV1. The image displayed on the liquid crystal display panel 16 is 
projected onto the screen 104 by the optical systems 100 and 102. More 

2 5 specifically, the light incident onto the liquid crystal display panel 16 by the 



44. 



The overlay image data DDV1 output by the extraction image overlay 
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illumination optical system 100 is modulated in accordance with image data 
supplied to the liquid crystal display panel 16, and the light exiting from the 
liquid crystal display panel 16 is projected onto the projection screen 104 by the 
projection optical system 102. The liquid crystal display panel 16 corresponds to 
5 the light modulation unit in the projection display apparatus according to the first 



The projection display apparatus is controlled by the remote control section 
28 in accordance with commands from the remote controller 29. The remote 
control section 28 controls mainly processing related to the extraction images. In 
10 accordance with commands received from the remote controller 29, this includes 
specifying the portion of an image to be extracted, selecting the type of extraction 
image and controlling the overlay position and extent of the extraction images, 
and whether the extraction images are displayed or not. 



15 extraction image overlay circuit 12 and remote control section 28 can be realized 
by a computer program. The computer program for realizing the functions of 
these parts can be provided in a format recorded on a computer-readable 
recording medium such as floppy disk, CD-ROM or the like. The program is read 
off the recording medium by the computer (projection display apparatus) and 

2 0 transferred to an internal storage device or an external storage device. 
Alternatively, the computer program may be supplied from a program supply 
apparatus via a communication route. When realizing the computer functions, 
a computer program stored in an internal storage device is executed by the 
computer CPU (microprocessor). A computer program recorded on a recording 

25 medium can also be executed directly by the computer. 



invention. 



Instead of hardware, the functions of the video signal conversion circuit 10, 
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As used in this specification, "computer" includes hardware and an 
operating system, with the hardware being operated under the control of the 
operating system. If the hardware is operated by an application program having 
no need of an operating system, then the hardware itself will constitute the 
5 computer. The hardware comprises at least a microprocessor like a CPU and 
means for reading a program recorded on a recording medium. For this purpose, 
the computer program includes program code for realizing the function of each of 
the means described in the foregoing. Some of the functions can be implemented 
by the operating system instead of an application program. 
10 The recording media in this invention include floppy disks, CD-ROM disks, 

opto-magnetic disks, IC cards, ROM cartridges, punched cards, bar codes and 
other such printed symbols, internal storage devices (including RAM and ROM) 
and external storage devices. 



15 respect to image data stored in the frame memory 22 and extraction image 
bitmap data BMD1 stored in the extraction image bitmap memory 26. Fig. 6 (a) 
shows the memory space of the frame memory 22, containing image data (text). 
Fig. 6 (b) shows the memory space of the extraction image bitmap memory 26, 
containing extraction image bitmap data BMD1 (a graph) and coordinate data PD 

2 0 showing the position and extent of the overlay. The (xl, yl), (x2, y2) of this 

coordinate data PD in Fig. 6 (b) correspond to the coordinates (xl, yl) and (x2, y2) 
in Fig. 6 (a). Fig. 6 (c) shows the overlay image data DDV1 consisting of the 
original image data overlaid with the extraction image bitmap data BMD1. 

The overlaying of the extraction image bitmap data BMD1 on the image 

2 5 data is effected based on the coordinate data PD. In the extraction image overlay 



Figs. 6(a)-(c) are diagrams for explaining the overlay operation with 




circuit 12 (Fig. 5), the stream of image data is input to the first multiplier 40 
while the second multiplier 42 receives only the extraction image bitmap data 
BMD1 for the portion defined by the coordinates (xl, yl) and (x2, y2), which is the 
overlay portion. The timing of the input of the extraction image bitmap data 
5 BMD1 to the multiplier 42 is controlled by the CPU 20 based on the coordinate 
data PD. Simultaneously with the input of the extraction image bitmap data 
BMD1 to the multiplier 42, the coefficients kl and k2 of the multipliers 40 and 
42 are adjusted. When extraction image bitmap data BMD1 is not being input to 
the multiplier 42, the coefficients kl and k2 of the multipliers 40 and 42 are set 
!b" 10 to (1, 0). When the extraction image bitmap data BMD1 is being input to the 
ift * multiplier 42, the coefficients kl and k2 are set to (0, 1). As a result, with respect 

~1 to pixels not in the area defined by the coordinate data (xl, yl) and (x2, y2), the 

I original image data (text) shown in Fig. 6 (a) is output by the extraction image 

overlay circuit 12, while with respect to the pixels within the area defined by the 
]j 15 coordinates (xl, yl), (x2, y2), the extraction image bitmap data BMD1 shown in 
□ Fig. 6 (b) is output by the extraction image overlay circuit 12. In this way, the 

extraction image bitmap data BMD1 is superimposed on the image data, forming 
the overlay image data DDV1 representing the overlay image shown in Fig. 6 (c). 
The extraction images can be generated in the extraction image bitmap 
2 0 memory 26 to correspond with the overlay position within the image data. Fig. 
7 is a diagram for explaining the extraction image bitmap data BMD1 expanded 
in the extraction image bitmap memory 26. A portion of the extraction image 
bitmap memory 26 corresponding to one frame of image data is allocated for 
developing the extraction image bitmap data BMD1, and the extraction image is 
2 5 expanded at the location defined by the coordinates (xl, yl), (x2, y2). When the 
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expansion takes place, as shown in Fig. 7, pixel data of the image data and the 
extraction image bitmap data BMD1 corresponding to the same position in the 
image are input simultaneously to the respective multipliers 40 and 42. At this 
time, for areas outside the area defined by the coordinate data PD coordinates (xl, 
5 yl) and (x2, y2), the coefficients (kl, k2) are set to (1, 0), while inside the area of 
the coordinates (xl, yl) and (x2, y2), the coefficients (kl, k2) are set to (0, 1). In 
this way, the original image data can be overlaid with the extraction image 
bitmap data BMD1, producing the overlay image data DDV1 representing the 
extraction image of Fig. 6 (c). 
10 As described above, when an extraction image is expanded as shown in Fig. 

7, one frame of memory capacity is required as the memory area for the extraction 
image bitmap data BMD1, but when it is expanded as shown in Fig. 6 (b), a 
memory capacity that is around the same size as the bitmap expanded extraction 



image is sufficient, so there is the advantage that the memory capacity can be 
1 5 small. 

Figs. 8(a)-(c) are diagrams for explaining examples of displays on a 
projection screen 104 of images input from a personal computer on which 
extraction images have been superimposed. Fig. 8 (a) shows input image (text) 
overlaid with two extraction images (pictures of tree). Fig. 8 (b) shows input 

2 0 image (text) overlaid with-two types of extraction images (pictures of a boat and 
a tree). Fig. 8 (c) shows the input image (text) overlaid with enlarged extraction 
image (picture of a boat) shown in Fig. 8 (b). 

The extraction images shown in Fig. 8 (a) and (b) are overlaid by specifying 
the overlay position within the projection image. In this case, the coordinate data 

2 5 PD comprises coordinates (xl, yl) showing the specified position, and coordinates 
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(x2, y2) defined by the predetermined size of extraction image. The extraction 
image shown in Fig. 8 (c) is overlaid by specifying the overlay position and extent 
within the projection image. In this case, the coordinate data PD comprises the 
preset coordinates (xl, yl) and the coordinates (x2, y2) corresponding to the 
5 specified size. 

Also, since the extraction image bitmap data BMD1 includes the 
coordinate data PD indicating the overlay position, an extraction image can be 
displayed at any point that is specified, using the remote controller 29. The 
extraction image bitmap data BMD1 and the coordinate data PD are being 

10 continually refreshed in sync with the sync signal RSYNC, so the remote 
controller 29 can be used to move an extraction image to any point within the 
projection image, on a realtime basis. Moreover, multiple extraction images can 
be displayed, as shown in Fig. 8 (b). A command issued by the remote controller 
29 and received by the remote control section 28 can be used to execute the 

15 program in the extraction image memory 24 to generate the extraction image 
bitmap data BMD1. 

The shape of the extraction image extracted by the image extraction 
section 74 is not limited to the rectangles shown in Figs. 8(a)-(c). Any shape 
specified using the remote controller 29 can be extracted from an original image 

2 0 by the image extraction section 74, so the extraction image can be oval, round, 
star-shaped, or a shape defined by straight lines. 

Fig. 9 is another diagram for explaining the display on a projection screen 
104 of an image input from a personal computer on which an extraction image 
has been superimposed. As shown in Fig. 9, an oval extraction image (picture of 

25 boat) is superimposed on the original image (text). 
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In this embodiment, the coordinate data PD includes two point coordinates 
defining the extraction image overlay position and extent. In the case of Fig. 9, 
the data is processed so that within the area specified by the coordinates, the 
portion where there is no extraction image is not overlaid. 



26 when the extraction image of Fig. 9 is expanded. In the case of this extraction 
image bitmap data BMD1, the shaded portion outside the oval is not to be 
overlaid on the input image, so the pixels of that portion are comprised using 
specified pixel data. The pixels where there is no extraction image are comprised 

10 of specified pixel data, for example, all the bits of the RGB pixel data can be set 
to 0. In this case, when the extraction image bitmap data BMD1 is input to the 
coefficient setting section 46, the coefficient setting section 46 checks the data to 
determine whether the pixels contain an extraction image. The system can be set 
so that when the input image data relates to pixels where there is no extraction 

15 image, the coefficients (kl, k2) of the multipliers 40 and 42 are changed to (1, 0). 
This makes it possible to ensure that only that portion of the extraction image 
bitmap data BMD1 that contains an extraction image will be overlaid on the 
original image data. It goes without saying that the coordinate data PD can be 
comprised of numerous point coordinates around the portion where the extraction 

2 0 image exists, in which case just the said portion containing the extraction image 
could be overlaid, based just on the coordinate data PD. 

In the examples shown in Figs. 8(a)-(c) and 9, the extraction images appear 
as filled-in images on the original input image. This overlay effect is obtained by 
the extraction bitmap data being substituted for part of the original image. In the 

2 5 extraction image overlay circuit 12 (Fig. 5) the multiplier coefficients (kl, k2) are 



Fig. 10 is a diagram for explaining the extraction image bitmap memory 
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set at (1, 0) for those portions where no extraction image is overlaid, while the 
coefficients (kl, k2) are set at (0, 1) for portions where an extraction image is 
overlaid. 

Transparent extractions can be applied by changing kl and k2. Setting 
5 both kl and k2 to 1/2, for example, would produce a transparent effect in the 
portion where the extraction image is overlaid on the input image. 

Figs. 11(a) and 11(b) are diagrams for explaining projected images overlaid 
with transparent extracted images. Fig. 11 (a) shows images (graphs 1 and 2) 
input from a computer. The broken line (graph 2) denotes the area specified as 

•=ss? 

tfl 10 the cutout portion. In Fig. 11 (b), the graph 2 portion of Fig. 11 (a) has been 
w extracted and overlaid on graph 1, which can be seen through graph 2. This 

lH shows the type of transparent overlay effect that can be achieved by setting the 

*° s * coefficients kl, k2 of the multipliers 40 and 42 in the extraction image overlay 

S circuit (Fig. 5) to 1/2. 

Tfi 15 The overlay images shown in Figs. 8(a)-(c), 9 and ll(a),(b) were obtained 

5^ using the multiplier coefficients kl, k2 set at a fixed value such as 0, 1 and 1/2. 

However, kl and k2 values can be used that change with time. For example, for 
portions where an extraction image is overlaid, the coefficients (kl, k2) can start 
at (0, 1) and, as time passes, can be gradually changed thus: (0.1, 0.9), (0.2, 
2 0 0.8) ... (1, 0). As a result, the extraction image overlay would start out looking 

solid, then would gradually become transparent and finally vanish. Such overlay 
effects can be obtained by changing the coefficients Kl and K2 with time. The 
coefficients are adjusted by the coefficient setting section 46 based on commands 
from the CPU 20. 

2 5 The extraction image overlay circuit 12 and frame memory 22 of this 
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embodiment correspond to the image overlay section according to the first aspect 
of this invention. Similarly, the extraction image memory 24 and extraction 
image bitmap memory 26 correspond to the extraction image memory of the first 
aspect of the invention. One of the memories 24 and 26 can be omitted. 

B. Second Embodiment: 

Fig. 12 is a block diagram for schematically illustrating the general 
configuration of a second embodiment of the projection display apparatus 
according to the first aspect of the invention. The projection display apparatus 
includes a video signal conversion circuit 60, a liquid crystal display driver circuit 
14, a liquid crystal display panel 16, a frame memory 22, an extraction image 
memory 24, a remote control section 28, a CPU 20, an illumination optical system 
100 and a projection optical system 102. The video signal conversion circuit 60, 
extraction image memory 24, remote control section 28 and CPU 20 are connected 
via a bus 1. The liquid crystal display driver circuit 14 is also connected to the 
bus 1, but the connection is not shown in Fig. 12. 

The projection display apparatus of this second embodiment does not have 
the extraction image overlay circuit 12 or the extraction image bitmap memory 
26 possessed by the first embodiment. In this embodiment, the video signal 
conversion circuit 60 is used to overlay extraction images on the original image. 
Extraction image bitmap data BMD1 is stored in the extraction image memory 
24. Thus, the video signal conversion circuit 60 and frame memory 22 correspond 
to the image overlay section of the first aspect of the invention. In this 
embodiment, only the extraction image memory 24 corresponds to the extraction 
image memory of the first aspect of the invention 
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Fig. 13 is a block diagram for schematically illustrating the configuration 
of the video signal conversion circuit 60. The video signal conversion circuit 60 
includes a sync separator 30, an A-D conversion section 32 and a video processor 
62. The sync separator 30 and A-D conversion section 32 have the same functions 
5 as the first embodiment, so further explanation thereof will be omitted. 

The video processor 62 is a microprocessor that performs overlay 
processing of the input image data and extraction image bitmap data, and 
controls the input and output of overlay image data to and from the frame 
memory 22. 

10 The image data DV1 output by the A-D conversion section 32 and the 

extraction image bitmap data BMD1 expanded in the extraction image memory 
24 are input to the video processor 62. In the video processor 62 the overlay 
image data is produced by selecting the image data DV1 and the extraction image 
bitmap data BMD1, and written into the frame memory 22. A data selector in the 

15 video processor 62 is used for selection of the image data DV1 and extraction 
image bitmap data BMD1. 

Fig. 14 is a block diagram showing the configuration of the video processor 
62. The video processor 62 includes a write controller 70, a read controller 72, an 
image extraction section 74 and a data selector 76. 

2 0 When image data DV1 is input to the video processor 62, the image 

extraction section 74 (Fig. 14) extracts the specified portion of the image data 
DV1, compresses the data and stores it in the extraction image memory 24 via the 
bus 1. The extraction image data does not have to be compressed, and it can be 
reduced instead. The remote controller 29 can be used to specify the portion of 

2 5 the image data to be extracted. When the extraction portion has been specified, 
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the CPU 20 outputs a sampling signal SMP corresponding to the extraction 
portion. Based on the sampling signal SMP, the image extraction section 74 
extracts the pixel data of the specified portion. In this way, it is possible to 
extract just the data relating to the pixels of the specified area. 
5 Image data DV1 and extraction image bitmap data BMD1 expanded in the 

extraction image memory 24 are input to the data selector 76 (Fig. 14), along with 
a selection signal SEL. There is a data selector 76 for each of the RGB colors. 
The selection of the image data DV1 and extraction image bitmap data BMD1 is 
done on a pixel data by pixel data basis and is controlled by means of the selection 

10 signal SEL. Thus, based on the selection signal SEL, the data selector 76 selects 
pixel data either one of the image data DV1 and the extraction image bitmap data 
BMD1 and writes the data into the frame memory 22. This data written into the 
frame memory 22 forms the overlay image data comprised of the original image 
overlaid with the extraction image. The selection signal SEL is generated by the 

15 CPU 20 according to the coordinate data PD. 

In this embodiment the overlay images seem filled in on the original image. 
This corresponds to when, in the first embodiment, the coefficients (kl, k2) of the 
multipliers 40 and 42 of extraction image overlay circuit 12 (Fig. 5) are set at (0, 
1) with respect to the extraction image overlay portion. 

2 0 When extraction image bitmap data BMD1 is expanded as shown in Fig. 

6 (b), only the extraction image bitmap data BMD1 for the area defined by the 
coordinate data PD coordinates (xl, yl) and (x2, y2) is input to the data selector 
76. The timing of the input of the extraction image bitmap data BMD1 to the 
data selector 76 is controlled by the CPU 20, based on the sync signal WSYNC 

2 5 and the coordinate data PD. The timing of the input of the extraction image 
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bitmap data BMD1 is determined by using coordinate data PD of the extraction 
image bitmap data BMD1 to obtain the input timing of the pixel image data DV1 
for the overlay position. Simultaneously with the input of the extraction image 
bitmap data BMD1, the extraction image bitmap data BMD1 is selected by the 
selection signal SEL. In this way, a selection between image data DV1 and 
extraction image bitmap data BMD1 can be made with respect to each pixel 
assigned to the same position in the image. 

When the extraction image bitmap data BMD1 is expanded as shown in 
Fig. 7, pixel data of the image data DV1 and extraction image bitmap data BMD1 
corresponding to the same position in the image are input simultaneously to the 
data selector 76. The input pixel data is specified based on the sync signal 
WSYNC. Thus, pixel data can be assigned to the same position in the original 
image by synchronizing the readout of the extraction image bitmap data BMD1 
from the extraction image memory 24 with the input of the image data DV1 to the 
video processor 62. Also, the extraction image can be superimposed on the 
original image by using the coordinate data PD as a basis for supplying the 
selection signal SEL to the data selector 76. 

When overlay image data is written to, or read from, the frame memory 22, 
the write controller 70 and read controller 72 generate addresses ADD1, ADD2 
and control signals CTR1, CTR2, which are supplied to the frame memory 22. 
Overlay image data is written to the frame memory 22 in accordance with address 
ADD1 and control signal CTR1 generated by the write controller 70, and read out 
of the frame memory 22 in accordance with address ADD2 and control signal 
CTR2 generated by the read controller 72. These addresses and control signals 
are based on the sync signals WSYNC and RSYNC. 
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The writing of overlay image data to the frame memory 22 is synchronized 
with the sync signal WSYNC. The reading of overlay image data from the frame 
memory 22 is synchronized with the sync signal RSYNC output by the liquid 
crystal display driver circuit 14 (Fig. 12). The sync signals WSYNC and RSYNC 
are not mutually synchronized. However, sync signals WSYNC and RSYNC can 
be synchronized. 

In this embodiment the overlay image data can be obtained by writing 
directly to the frame memory 22. Overlay image data written to the frame 
memory 22 is read out by the video processor 62. 

Overlay image data DDV2 output by the video signal conversion circuit 60 
(Fig. 12) is supplied to the liquid crystal display driver circuit 14 (Fig. 12). Based 
on this overlay image data DDV2, the liquid crystal display driver circuit 14 
displays on the liquid crystal display panel 16 the image overlaid with the 
extraction image. The image displayed on the liquid crystal display panel 16 is 
projected onto the projection screen 104 by the optical systems 100 and 102. 

In the first and second embodiments described in the foregoing, at least a 
portion of images input to the projection display apparatus can be extracted as 
the extraction image internally. It is therefore possible to extract part of one 
input image and overlay it on another. This means it is possible to extract an 
image from an image signal input from a personal computer, video recorder or TV 
and overlay the extracted image on an input image. Moreover, by using the 
coordinate data PD, an extraction image can be superimposed at any desired 
point on the input image, and enlarged or reduced. 

C. Third Embodiment: 
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Embodiments of a second aspect of the invention are described below. 

C-l. Configuration and operation of the projection display apparatus: 

Fig. 15 is a block diagram for schematically illustrating the general 
5 configuration of an embodiment of the projection display apparatus according to 
a second aspect of the invention. The projection display apparatus includes a 
video signal processing circuit 210, an on-screen display (OSD) controller 212, an 
OSD memory 213, a liquid crystal light valve driver circuit 214, a liquid crystal 
light valve 216, a frame memory 222, an extraction image memory 224, a remote 

CJ 

*p 10 control section 28, a CPU 20, an illumination optical system 100 and a projection 
w optical system 102. The video signal processing circuit 210, OSD controller 212, 

extraction image memory 224, remote control section 28 and CPU 20 are 

connected by a bus 1. 

bi The video signal processing circuit 210 is used to perform analog-digital 

H 15 conversion of input analog video signals AVI, write the converted image data into 
the frame memory 222 and retrieve image data from the frame memory 222. The 
analog video signal AVI can be an RGB signal SI carrying a computer screen 
image, or a composite image signal S2 from a video recorder, TV or the like. 

Fig. 16 is a block diagram for schematically illustrating the configuration 
2 0 of the video signal processing circuit 210. The video signal processing circuit 210 
includes a sync separator 230, an A-D conversion section 232 and a video 
processor 234. The functions of the sync separator 230 and A-D conversion 
section 232 are the same as those of the sync separator 30 and A-D conversion 
section 32 of the first embodiment (Fig. 2), so further explanation thereof will be 
2 5 omitted. 
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The video processor 234 is a microprocessor that performs various image 
processing functions such as controlling the input and output of image data and 
extraction image data to and from the frame memory 222 and extraction image 
memory 224. Image data DV1 from the A-D conversion section 232 is input to the 
5 video processor 234. Specific image data that includes extraction image data 
CPD1 stored in the extraction image memory 224 and background image data 
BGD1 generated by the CPU 20 is input to the video processor 234, via bus 1. 

Fig. 17 is a block diagram showing the configuration of the video processor 
234. The video processor 234 includes a write controller 270, a read controller 272, 
42 10 an extraction controller 274 and a data selector 276. The controllers 270 and 272 
yj have the same functions as the controllers 70 and 72 of the first embodiment (Fig. 

HJ 3), so further explanation thereof will be omitted. 

H Image data DV1 and specific image data SPD1 that includes extraction 

P image bitmap data BMD1 stored in the extraction image memory 224 and 

H 15 background image data BGD generated by the CPU 20 are input to the data 
™ selector 276, along with a selection signal SEL. There is a data selector 276 for 

each of the colors RGB. The selection of the image data DV1 and specific image 
data SPD1 is controlled by the selection signal SEL. Which data is selected 
depends on whether the system is in normal display mode or specific image 
2 0 display mode. These modes are discussed below. Based on the selection signal 
SEL, the data selector 276 selects either image data DV1 or specific image data 
SPD1. Thus, according to the system mode, either one of image data DV1 and 
specific image data SPD1 is written into the frame memory 222. When user uses 
the remote controller 29 to select the system mode, the selection signal SEL is 
2 5 generated by the CPU 20. 
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The writing of image data to the frame memory 222 is synchronized by the 
sync signal WSYNC when the data to be written to the memory 222 is input 
image data DV1. When the data to be written to the memory 222 is specific 
image data SPD1, the write operation is controlled by signals supplied to the 
write controller 270 by the CPU 20. The retrieval of image data from the frame 
memory 222 and the downstream processing of image data DV2 output by the 
video processor 234 are synchronized by the sync signal RSYNC output by the 
liquid crystal display driver circuit 214 (Fig. 15), discussed below, which is 
optimized for driving the liquid crystal light valve 216. The sync signal RSYNC 
is produced by a sync signal generator (not shown) in the video processor 234. 
The sync signals WSYNC and RSYNC are not mutually synchronized. However, 
sync signals WSYNC and RSYNC can be used synchronized. The sync signal 
generator does not have to be provided in the video processor 234, and can instead 
be provided in the liquid crystal light valve driver circuit 214, for example, or can 
be configured as an independent component. 

When image data that has been written to the frame memory 222 is read 
out, the function of the extraction controller 274 is to extract a specified portion 
of the image data. The extraction controller 274 also enlarges or reduces the 
extraction image data in accordance with the enlarging/reducing factor that has 
been set. Another function of the extraction controller 274 is to write the 
extraction image data CPD1 to the extraction image memory 224 via the bus 1. 
The portion of the image data to be extracted (extraction area) can be specified 
using the remote controller 29. When the extraction area has been specified, the 
CPU 20 outputs an extraction address SADD corresponding to the extraction 
portion. Based on the extraction address SADD and address ADD2 read from the 
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read controller 272, the extraction controller 274 extracts the image data of the 
specified portion. This make it possible to extract only the specified portion of the 
image data. 

Image data DV1 or specific image data SPD1 stored in the frame memory 
5 222 is read out of the frame memory and output from the video processor 234 as 
image data DV2. The readout operation is synchronized by the sync signal 



The extraction image memory 224 shown in Fig. 15 is for storing extraction 
image data CPD1 extracted by the extraction controller 274 of the video processor 

10 234 (Fig. 17). Extraction image data CPD1 is stored in the extraction image 
memory 224 in a specific format. There are no particular limitations on the 
specific format other than it be decided beforehand. For example, it can be 
compressed data, or bitmap data. If the extraction image data CPD1 is specified 
as compressed data, it is written into the extraction image memory 224 after 

15 being compressed by the CPU 20 or the extraction controller 274. Similarly, when 
the data is read out of the extraction image memory 224, it is expanded by the 
CPU 20 or the extraction controller 274. 

Fig. 18 is a diagram illustrating the extraction image memory 224. The 
extraction image memory 224 stores the data for one extraction image. The 

2 0 stored data includes an information ID denoting the content of the extraction 
image data, and extraction image data CPD1. The extraction image memory 224 
is not limited to storing one set of data, and may instead be used to store multiple 



25 representing pointer images and menu screens for controlling the functions of 



RSYNC. 



sets. 



The OSD controller 212 shown in Fig. 15 generates OSD image data 
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each part of the projection display apparatus in accordance with commands 
received from the remote controller 29 via the remote control section 28. The 
OSD memory 213 contains pointer image data and graphics and font data for the 
menu screens, stored in a specific format. To display the menu screens and 
5 pointers images, the OSD controller 212 reads out the corresponding data from 
the OSD memory 213 and generates OSD image data. The OSD controller 212 
combines this OSD image data with image data DV2 output by the video signal 
processing circuit 210. The image data DV2 and OSD image data could also be 
combined by providing the OSD controller 212 with a selector. Alternatively, it 
1 0 could be done by providing two multipliers that multiple the image data D V2 and 
OSD image data by a fixed factor, and an adder that adds the results of the 
multiplications. Images for specifying the extraction area (extraction area 
specifying image) are generated by the OSD controller 212. 



15 crystal light valve driver circuit 214. Based on the image data DV3, the 
illumination light from the illumination optical system 100 is modulated by the 
liquid crystal light valve 216, and the modulated light is projected onto the screen 
104 by the projection optical system 102 to display the image. The liquid crystal 
light valve 216 corresponds to the electro-optical device of the second aspect of the 

20 invention. The liquid crystal light valve driver circuit 214 corresponds to the 
image display signal generator of the second aspect of the invention. 

Here, the term projection optical system is used in a broad sense that also 
encompasses the illumination optical system. The liquid crystal light valve driver 
circuit 214 can be formed on the substrate of the liquid crystal light valve 216 as 

2 5 the electro -optical device, integrating the two components. 



Image data DV3 output by the OSD controller 212 is input to the liquid 
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The image data DV3 output by the OSD controller 212 can be enlarged or 
reduced by an enlarging/reducing circuit (not shown) provided between the OSD 
controller 212 and the liquid crystal light valve driver circuit 214. 

The projection display apparatus is controlled by the remote control section 
28, based on commands from the remote controller 29 (Fig. 15). The remote 
control section 28 controls mainly processing related to extraction images. In 
accordance with commands received from the remote controller 29, this includes 
specifying the extraction portion of the image data, and whether extraction 
images are displayed or not. 

The functions of the video signal processing circuit 210, OSD controller 212 
and remote control section 28 can be implemented by a computer program instead 
of in hardware. 

When the remote controller 29 is used to select the normal image display 
mode, digital image data DV1 representing analog image signals AVI externally 
input to the video signal processing circuit 210 is stored in the frame memory 222 
and the images can be displayed on the screen 104. Fig. 19 is a diagram for 
explaining externally input images displayed on the projection screen 104. When 
the remote controller 29 is used to select the specific image display mode, 
background image data BGD1 generated by the CPU 20 and extraction image 
data CPD1 stored in the extraction image memory 224 are stored in the frame 
memory 222 as specific image data SPD1 and the specific images represented by 
the data SPD1 can be displayed on the screen 104. Fig. 20 is a diagram for 
explaining the projection screen display of a specific image represented by the 
specific image data SPD1 that includes background image data BGD1 and 
extraction image data CPD1 stored in extraction image memory 224. 




When the user selects the specific image display mode, an extraction image 
can be selected from among those stored in the extraction image memory 224 and 
displayed as a specific image. It is also possible to select multiple extraction 
images from among those stored in the extraction image memory 224 and have 
them displayed repeatedly in order. Figs. 21(a)-(c) are diagrams for explaining 
the display on the projection screen 104 of sequentially selected extraction images 
represented by extraction image data CPD1 (A), CPD1 (B) and CPD1 (C). 

During question and answer sessions in a presentation or when a short 
time is needed before a new set of images can be displayed, the presentation can 
be enhanced by displaying specific images in the form of corporate logos and 
product images and the like instead of presentation images. 

The extraction image data CPD1 stored in the memory 224 can be 
extracted as explained below. 

C-2. Extracting images: 

Figs. 22 to 27 are diagrams illustrating the procedure for cutting away 
from an image being input to the projection display apparatus, to an extraction 
image (a user logo image). Figs. 22 to 27 shown display images on the projection 
screen 104. 

The remote controller 29 has a menu key (not shown). When the menu key 
is pressed, the OSD controller 212 (Fig. 15) displays a menu screen. Selecting the 
menu entry " Extraction image setting " and pressing the enter key on the remote 
controller 29 initiates the extraction image setting mode. Below, the term "select" 
will be used to mean using the remote controller 29 to select a menu item such as 
letters and areas and pressing the enter key on the remote controller 29. When 




the extraction image setting mode starts, the writing of data to the frame memory 
222 is stopped. This stop can be done according to starting the extraction image 
setting mode. A user can use the selection of this mode by using remote controller 
29 as a way of stopping a display of such as moving images. 

When the writing of data to the frame memory 222 stops, the image in the 
frame memory 222 at that point is displayed on the screen, as shown in Fig. 22. 
Also, the extraction image setting screen is displayed by the OSD controller 212, 
showing the question "Use part of this image as an extraction image?" It is 
decided whether or not to extract image from present displayed image. Extracted 
image is referred to as extraction target image. If "No" is selected, the extraction 
image setting mode is terminated and the menu screen reappears. If "Yes" is 
selected, the OSD controller 212 displays a selecting frame WF of a preset size for 
selecting the extraction image, as shown in Fig. 23. The selecting frame WF 
comprises two black outlines separated by a white space. This makes the selecting 
frame WF readily visible on the images. Thus, user can easily select a extraction 
area. If required, a system configuration can be used that allows the size of the 
frame to be set by the user. On the remote controller 29, a pointing device, such 
as an arrow-key device, is used to position the selecting frame WF and select the 
part to be extracted on the extraction target image. 

As shown in Fig. 24, when user selects the part of the extraction target 
image, the selected image (referred to as selected extraction image) SCPD is then 
displayed in the center of the screen. A black image is used to mask portions 
other than the selected extraction image SCPD. The OSD controller 212 then 
displays the question "Use this image?" on the extraction image setting screen. 
It is decided whether or not to use the present image. If "No" is selected, the 
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extraction image setting mode is terminated and the menu screen reappears. If 
"Yes" is selected, the OSD controller 212 displays "Please set display 
magnification," shown in Fig. 25. 

When one of the magnifications displayed on the extraction image setting 
5 screen is chosen, the selected extraction image SCPD is displayed at that 
magnification. If a different magnification is then chosen, the image will be 
displayed at the new magnification. This enables users to try different settings 
before making a final selection. Desired magnification is set by pressing the enter 
key. The system can instead be configured to accept any desired magnification 
41 10 setting. 

yj When the extraction image and magnification have been selected, the OSD 

fli controller 212 displays "Save this image?" on the extraction image setting screen, 

^ h as shown in Figure 26. It is decided whether or not to save the image data 

^ ^ representing this image in the extraction image memory 224 (Fig. 15) as 

~ 15 extraction image data CPD1. If "No" is selected, the extraction image setting 
mode is terminated and the menu screen reappears. If "Yes" is selected the 
extraction image data CPD1 is saved in the extraction image memory 224 (Fig. 
15) and the message "The extraction image has been saved" is displayed (Fig. 27). 
During setting above, menu screen reappears by pressing the menu key. 
2 0 This procedure enables a user to readily select a desired extraction target 

image and extract a desired image by following the extraction image setting 
screens. Also, the image can be saved in the extraction image memory 224 with 
a chosen condition (magnification), which can be checked before final selection. 

The video processor 234, OSD controller 212, remote control section 28 and 
2 5 CPU 20 of this embodiment correspond to the image extraction section and 
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specific image display control section according to the second aspect of the 
invention. 

D. Fourth Embodiment: 
5 Fig. 28 is a block diagram for schematically illustrating the general 

configuration of an embodiment of the projection display apparatus according to 
second and third aspects of the invention. Other than the inclusion of an 
operating condition judging section 226, this projection display apparatus has the 
same configuration as that of the third embodiment, so further explanation 

1 0 thereof will be omitted. 

Fig. 29 is a block diagram showing the configuration of the operating 
condition judging section 226. The operating condition judging section includes 
an image signal detector 242, a system start detector 244 and a judging section 
246. The image signal detector 242 receives the sync signal WSYNC included in 

15 the image signal and detects whether an image signal is being input to the 
projection display apparatus. The system start detector 244 receives a power 
supply voltage Vcc and detects whether the projection display apparatus is on and 
can display an image. Based on the detection signals Dl and D2 signifying 
detection by the image signal detector 242 and system start detector 244, the 

2 0 judging section 246 judges whether an externally input image can be displayed. 

Figs. 30(a)-(e) are time charts of the operation of the operating condition 
judging section 226. Fig. 30 (a) shows the power supply voltage Vcc, Fig. 30 (b) 
shows start detection signal D2 output from the system start detector 244, Fig. 
30 (c) shows the sync signal WSYNC included in image signals input to the 

2 5 projection display apparatus, Fig. 30 (d) shows detection signal Dl output from 



43 



# • 



the image signal detector 242, and Fig. 30 (e) shows operating condition judging 
signal SPDMODE. 

When the supply voltage Vcc is high enough for the projection display 
apparatus to start operating, after a prescribed interval T2 the start detection 
5 signal D2 changes from Low to High. Once the projection display apparatus is 
provided with a supply voltage, it is ready to display specific images in a 
relatively short time. However, some time is required as a stabilization period 
before externally input images can be displayed, to allow such as sync clocks to 
be generated on which internal circuits are operated. The period T2 represents 

1 0 this stabilization period. When the start detection signal D2 is Low it signifies 
that the system is not yet display-operational. At this time, the operating 
condition judging signal SPDMODE also is Low, signifying that the system is in 
the specific image display mode in which specific images are displayed. When the 
start detection signal D2 goes High, signal SPDMODE also goes High, signifying 

15 the system is in the normal display mode in which input images are displayed. 

The image signal detector 242 detects whether the sync signal WSYNC is 
being input at prescribed intervals Tc as shown in Fig 30(c). When the pulse 
signal is being input at the prescribed intervals Tc, sync detection signal Dl goes 
High as shown in Fig. 30(d). When it is detected that pulse signal is not being 

2 0 input at the intervals Tc, after a prescribed period Tl the sync detection signal 
Dl goes Low. The prescribed period Tl represents a detection margin. When 
detection signal Dl is Low, operating condition judging signal SPDMODE 
changes to Low, and specific images can be displayed. 



2 5 started the operating condition judging section 226 detects whether the system 



Thus, in this embodiment, after the projection display apparatus has been 
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state enables images to be displayed, and also detects whether an image signal 
is being received. The system can then automatically switch between normal 
display mode in which input images are displayed, and specific image display 
mode in which specific images (explained in third embodiment) are displayed. 
5 The operating condition judging section 226 of this embodiment 

corresponds to the operating condition judging section of the second and third 
aspects of the invention. Also, the video processor 234, OSD controller 212 and 
CPU 20 correspond to the image extraction section and specific image display 
control section of the second and third aspects. 
10 Although the image signal detector 242 uses the sync signal WSYNC to 

detect whether image signals are being input, this is not limitative, and various 
detection methods can be used. For example, color signals or luminance signals 
could be used, with an image signal staying at black level for a certain time 
signifying that an image signal is not being received. 

15 

The present invention is in no way limited to the details of the examples 
and embodiments described in the foregoing but various changes and 
modifications may be made without departing from the scope. For example, the 
following modifications are also possible. 

2 0 The first to fourth embodiments have been described using a projection 

display apparatus as an example, but this is not limitative, with the invention 
being applicable to various other types of image display apparatus. 

In the case of the first embodiment, the data selector 76 shown in Fig. 14 
could be used to superimpose the extraction images instead of the two multipliers 

2 5 40 and 42 and the adder 44 used in the extraction image overlay circuit 12 (Fig. 
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5). This would enable the extraction images to be given a filled-in effect 
equivalent to the effect obtained when the coefficients (kl, k2) of the multipliers 
40, 42 are set at (1, 0) or (0, 1). 

With respect again to the multipliers 40 and 42 and the adder 44 used by 
5 the circuit 12 to superimpose extraction images in the first embodiment, if the 
coefficients kl and k2 are both set at 1/2 to provide transparent images, the 
multipliers 40 and 42 will not be needed. Instead, the same effect can be obtained 
by effecting a bit shift in the adder 44 to remove the low-order bit from the data 
that is added. 

10 In the second embodiment, the multipliers and adder shown in Fig. 5 can 

be used instead of the data selector 76 (Fig. 14) to superimpose extraction images. 
This would enable transparent as well as filled-in overlay effects to be provided. 

In the first and second embodiments, while memory capacity equivalent to 
one frame of image data is allocated for expanding extraction images, as shown 

15 in Fig. 7, the same effect can be obtained by using flags in place of coordinate data 
PD. . For example, the pixel data of an extraction graphic in the extraction bitmap 
data could be provided with a one-bit flag that could be used to determine the 
presence or absence of the graphic. Depending on the presence or absence of the 
flag, an adjustment could be made to the coefficients kl, k2 of the multipliers 40, 

2 0 42 (Fig. 5), in the case of the first embodiment, or to the selection by the data 

selector 76 (Fig. 14), in the case of the second embodiment. In this way, the same 
effect could be obtained as when coordinate data is used. 

In the first and second embodiments, extraction image bitmap data BMD1 
is expanded and stored in the extraction image bitmap memory 26 or extraction 

2 5 image memory 24, but this expansion is not limited to the memories 26 and 24 
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and may be effected in other storage areas prepared for the purpose. 

In the first and second embodiments, the only extraction images stored in 
the extraction image memory 24 are those extracted by the extraction controller 
74, but this is not limitative. Instead, images produced using other devices, such 
5 as scanned images and images produced on a computer, can also be stored in the 
extraction image memory 24. Doing this makes it possible to overlay original 
images with other images in addition to images extracted by the projection 
display apparatus. 



10 on input images are maintained in the extraction image memory 24, but the 
invention is not limited to this configuration. Instead, bitmap data of graphics 
drawn using the remote controller 29 could be written directly to the extraction 
image bitmap memory 26, enabling drawn images to be used as overlays. This 
would make it possible for a user using a drawing program to overlay an 

15 extraction image of a desired shape, such as a free curve or the like, specified with 
the remote control 29. 

The third and fourth embodiments have been described with reference to 
writing specific image data SPD1 into the frame memory 222 to display specific 
images, but the invention is not limited to this. Instead, for example, the specific 

2 0 image data SPD1 can be written to the OSD memory 213 and displayed as OSD 
images by the OSD controller 212. 

The third embodiment, has been described, using as an example, 
employing the image extraction section according to the second aspect of the 
invention to display specific images that include arbitrarily extracted images. 

2 5 However, this is not limitative. A projection display apparatus configuration can 



In the first and second embodiments, moreover, images to be superimposed 
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be used that does not include an image extraction section, with specific images 
supplied by a computer or from recording media read by a reading apparatus 
being displayed. 

The operating conditions described with reference to the fourth 
embodiment are not limited to the operational status of the projection display 
apparatus or to whether image signals are being received. Various other 
conditions can be set and associated detection circuits included in the operating 
condition judging section. 

In the first and second embodiments a liquid crystal display panel 16 is 
used as the light modulation unit of the projection display apparatus, but the 
invention is not limited to this and can use as the light modulation unit any 
means that is able to modify luminance based on the image data. For example, 
a light modulation unit can be used that utilizes light reflected by a pixel array 
of mirror elements, or a CRT or plasma display panel or the like. Note that, 
usually, a CRT or plasma display panel are not called light modulation unit. 

Similarly, the electro-optical device used in the third and fourth 
embodiments is not limited to the liquid crystal light valve 216. Various other 
devices that emit light according to image signal are usable as electro-optical 
device, such as a DMD (digital micromirror device, trademark of Texas 
Instruments Inc.), CRT or plasma display panel. 

In the described embodiments, part of the configuration implemented by 
hardware can instead be implemented by software and, conversely, part of the 
configuration implemented by software can instead by implemented by hardware. 



Industrial Applicability 



48 





The present invention is applicable to a variety of image display 
apparatuses. The projection display apparatuses of the present invention is 
applicable to projecting onto a screen images input by such as a computer and 
a video recorder. 
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